Using Elimination Theory to construct Rigid Matrices 



Abhinav Kumar* Satyanarayana V. Lokamj 
Vijay M. Patankar^, Jayalal Sarma M. N.* 

October 28, 2009 



Abstract 

The rigidity of a matrix A for target rank r is the minimum number of entries of 
A that must be changed to ensure that the rank of the altered matrix is at most r. 
Since its introduction by Valiant [Val77], rigidity and similar rank-robustness functions 
of matrices have found numerous applications in circuit complexity, communication 
complexity, and learning complexity. Almost all n x n matrices over an infinite field 
have a rigidity of (n — r) 2 . It is a long-standing open question to construct infinite 
families of explicit matrices even with superlinear rigidity when r = £l(n). 

In this paper, we construct an infinite family of complex matrices with the largest 
possible, i.e., (n — r) 2 , rigidity. The entries of an n x n matrix in this family are distinct 
primitive roots of unity of orders roughly exp(n 4 logn). To the best of our knowledge, 
this is the first family of concrete (but not entirely explicit) matrices having maximal 
rigidity and a succinct algebraic description. 

Our construction is based on elimination theory of polynomial ideals. In particular, 
we use results on the existence of polynomials in elimination ideals with effective degree 
upper bounds (effective Nullstellensatz) . Using elementary algebraic geometry, we 
prove that the dimension of the affine variety of matrices of rigidity at most k is 
exactly n 2 — (n — r) 2 + k. Finally, we use elimination theory to examine whether the 
rigidity function is semicontinuous. 



1 Introduction 



Valiant [Val77] introduced the notion of matrix rigidity. The rigidity function Rig(A, r) of 
a matrix A for target rank r is denned to be the smallest number of entries of A that must 
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be changed to ensure that the altered matrix has rank at most r. It is easy to see that 
for every n x n matrix A (over any field), Rig(A, r) ^ (n — r) 2 . Valiant also showed that, 
over an infinite field, almost all matrices have rigidity exactly {n — r) 2 . It is a long-standing 
open question to construct infinite families of explicit matrices with superlinear rigidity for 
r = Q(n). Here, by an explicit family, we mean that the n x n matrix in the family is 
computable by a deterministic Turing machine in time polynomial in n or by a Boolean 
circuit of size polynomial in n. Lower bounds on rigidity of explicit matrices are motivated 
by their numerous applications in complexity theory. In particular, Valiant showed that lower 
bounds of the form Rig(A, en) = n 1+s (where e and 5 are some positive constants) imply 
that the linear transformation defined by A cannot be computed by arithmetic circuits of 
linear size and logarithmic depth consisting of gates that compute linear functions of their 
inputs. Since then, applications of lower bounds on rigidity and similar rank-robustness 
functions have been found in circuit complexity, communication complexity, and learning 
complexity ([FKL+01],[For02],[Raz89],[Lok01], [PP04],[LS09]). Two comprehensive surveys 
on this topic are [CodOO] and [Chc05]. Over finite fields, the best known lower bound 
for explicit A was first proved by Friedman [Fri93] and is Rig(A, r) = Q(— log-) for parity 
check matrices of good error- correcting codes. Over infinite fields, the same lower bound was 
proved by Shokrollahi, Spielman, and Stemann [SSS97] for Cauchy matrices, Discrete Fourier 
Transform matrices of prime order (see [LokOO]), and other families. Note that this type of 
lower bound reduces to the trivial Rig(A, r) = Q(n) when r = Q(n). In [Lok06], lower bounds 
of the form Rig(A, en) = Q(n 2 ) were proved when A = {^/pjk) or when A = (exp(27i\/pjk)), 
where pjk are the first n 2 primes. These matrices, however, are not explicit in the sense 
defined above. 

In this paper, we construct an infinite family of complex matrices with the highest pos- 
sible, i.e., (n — r) 2 rigidity. The entries of the n x n matrix in this family are primitive roots 
of unity of orders roughly exp(ri 4 logn). We show that the real parts of these matrices are 
also maximally rigid. Like the matrices in [Lok06], this family of matrices is not explicit in 
the sense of efficient computability described earlier. However, one of the motivations for 
studying rigidity comes from algebraic complexity. In the world of algebraic complexity, any 
element of the ground field (in our case C) is considered a primitive or atomic object. In this 
sense, the matrices we construct are explicitly described algebraic entities. To the best of 
our knowledge, this is the first construction giving an infinite family of non-generic/concrete 
matrices with maximum rigidity. It is still unsatisfactory, though, that the roots of unity 
in our matrices have orders exponential in n. Earlier constructions in [Lok06] use roots of 
unity of orders 0(n 2 ) but the bounds on rigidity proved there are weaker: n(n — cr) for some 
constant c > 2. 

We pursue a general approach to studying rigidity based on elementary algebraic geome- 
try and elimination theory. To set up the formalism of this approach, we begin by reproving 
Valiant's result that the set of matrices of rigidity less than (n — r) 2 form a Zariski closed 
set in C nxn , i.e., such matrices are solutions of a finite system of polynomial equations 
(hence a generic matrix has rigidity at least (n — r) 2 ). In fact, we prove a more general 
statement: the set of matrices of rigidity at most k has dimension (as an affine variety) 
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exactly n 2 — (n — r) 2 + k. This sheds light on the geometric structure of rigid matrices. 
Our transversality argument in this context is clearer and cleaner than an earlier attempt 
in this direction (in the projective setting) by [LTV03]. To look for specific matrices of high 
rigidity, we consider certain elimination ideals associated to matrices with rigidity at most k. 
A result in [BMMR02] using effective Nullstellensatz bounds ([Bro87, K0I88]) shows that an 
elimination ideal of a polynomial ideal must always contain a nonzero polynomial with an 
explicit degree upper bound (Theorem 9). We then use simple facts from algebraic number 
theory to prove that a matrix whose entries are primitive roots of sufficiently high orders 
cannot satisfy any polynomial with such a degree upper bound. This gives us the claimed 
family of matrices of maximum rigidity. 

Our primary objects of interest in this paper are the varieties of matrices with rigidity at 
most k. For a fixed k, we have a natural decomposition of this variety based on the patterns of 
changes. We prove that this natural decomposition is indeed a decomposition into irreducible 
components (Corollary 15). In fact, these components are defined by elimination ideals of 
determinantal ideals generated by all the (r + 1) x (r + 1) minors of an n x n matrix of 
indeterminates. Better effective upper bounds on the degree of a nonzero polynomial in 
the elimination ideal of determinantal ideals than given by Theorem 9 would lead to similar 
improvements in the bound on the order of the primitive roots of unity we use to construct our 
rigid matrices. While determinantal ideals have been well-studied in mathematical literature, 
their elimination theory does not seem to have been as well-studied. Application to rigidity 
of these elimination ideals of determinantal ideals might be a natural motivation for studying 
them. 

We next consider the question: given a matrix A, is there a small neighborhood of A 
within which the rigidity function is nondecreasing, i.e. such that every matrix in this 
neighborhood has rigidity at least equal to that of Al This is related to the notion of 
semicontinuity of the rigidity function. We give a family of examples to show that the 
rigidity function is in general not semicontinuous. However, the specific matrices we produce 
above, by their very construction, have neighborhoods within which rigidity is nondecreasing. 

The rest of the paper is organized as follows. In the next two subsections, we introduce 
some definitions and notations and recall a basic result from elimination theory. Much of the 
necessary background from basic algebraic geometry is reviewed in Appendix A. We intro- 
duce our main approach in Section 2, reprove Valiant's theorem, and compute the dimension 
of the variety of matrices of rigidity at most k. We present our new construction of max- 
imally rigid matrices in Section 2.3. Connection to the elimination ideals of determinantal 
ideals is established in Section 3. In Section 4 and Appendix C, we study semicontinuity of 
the rigidity function through examples and counterexamples. 

1.1 Definitions and Notations 

Let F be a field. Then, by M n (F) we denote the algebra of n x n matrices over F . At times, 
when it is clear from the context, we will denote M n (F) by M n . Let X G M n (F). Then by 
Xij we will denote the (2, j)-th entry of X. Given X e M n (F), the support of X is defined 
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as Supp(X) := \ X^ ^ G F}. Given a non-negative integer k, we define 

S(k) := {X G M n (F) : \Supp(X)\ ^ k}. 

Thus, S(k) is the set of matrices over F with at most k non-zero entries. A pattern it is a 
subset of the positions of an n x n matrix. Then, we define: 

S(w) := {X G M n (F) : Supp(X) C vr}. 

Note that = U\ v \ =k S(v). 

We say that a matrix X is (r, fc)-rigid if changing at most k entries of X does not bring 
down the rank of the matrix to a value ^ r. More formally, 

Definition 1. A matrix X is (r, k)-rigid if rank(X + T) > r whenever T G S(k). 

Definition 2. The rigidity function Rig(X, r) is the smallest integer k for which the matrix 
X is not (r, k) -rigid. That is, Rig(X, r) is the minimum number of entries we need to change 
in the matrix X so that the rank becomes at most r: 

Rig(X, r) := mm{Supp(T) : rank(X + T) r}. 

Sometimes, we will allow T to be chosen in M n (L) for L an extension field of F. In this 
case we will denote the rigidity by Rig(X,r,L). 

Let RIG(n, r, k) denote the set of n x n matrices X such that Rig(X, r) = k. Similarly, 
we define RIG(n, r, ^ k) to be the set of matrices of rigidity at least k and RIG(n, r, ^ k) to 
be the set of matrices of rigidity at most k. For a pattern tt of size k, let RIG(n, r, it) be the 
set of matrices X such that for some T n G S(tt) we have rank(X + T n ) ^ r. Then we have 

RIG(ra,r,< k) = (J RIG(n,r,vr). 

7r,|7r|=A; 

1.2 Elimination Theory: Closure Theorem 

We review much of the necessary background from algebraic geometry in Appendix A. Here 
we recall a basic result from Elimination Theory. As the name suggests, Elimination Theory 
deals with elimination of a subset of variables from a given set of polynomial equations and 
finding the reduced set of polynomial equations (not involving the eliminated variables). 
The main results of Elimination Theory, especially the Closure Theorem, describe a precise 
relation between the reduced ideal and the given ideal, and its corresponding geometric 
interpretation. 

Given an ideal / = (fx, ■ ■ ■ , f s ) Q F[x\, . . . , x n ], the Z-th elimination ideal 1\ is the ideal 
of F[xi+i, ■ ■ .,x n ] defined by h := I H F[xi+x, ...,x n ]. 
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Theorem 3. (Closure Theorem, page 125, Theorem 3 of [CLO07]) 

Let I be an ideal of F[x\, . . . , x n , yi, . . . , y m ] and I n := If] F[yi, . . . , y m ] be the n-th elimina- 
tion ideal associated to I . Let V(I) and V(I n ) be the subvarieties of A n+m and A m (the affine 
spaces over F of dimension n + m and m respectively) defined by I and I n respectively. Let 
p be the natural projection map from A n+m — > A m (projection map onto the y- coordinates) . 
Then, 

1. V(I n ) is the smallest (closed) affine variety containing p(V (I)) C A' m . In other words, 
V{In) «s the Zariski closure ofp(V(I))(F) C F m . 

2. When V(I)(F) ^ <fi, there is an affine variety W strictly contained in V(I n ) such that 
V(I n )-WC P (V(I)). 

2 Use of Elimination Theory 

2.1 Determinantal Ideals and their Elimination Ideals 

We would like to investigate the structure of the sets RIG(n, r, ^ k) and RIG(n, r, it) and their 
Zariski closures 

W(n, r, ^ k) := R\G(n, r, ^ k) and 
W(n, r, 7r) := RIG(n, r, n) 

in the Tridimensional affine space of n x n matrices. Let X be an n x n matrix with entries 
being indeterminates xi, . . . , x n 2. For a pattern ir of k positions, let T n be the n x n matrix 
with indeterminates t\, . . . , tk in the positions given by it. Note that saying X + T v has rank 
at most r is equivalent to saying that all its (r + 1) x (r + 1) minors vanish. Let us consider 
the ideal generated by these minors: 

I(n,r,n) := ( Minors ( r+ i) X ( r+ i) {X + T w )) C F[x 1 , . . . ,x n 2,t 1 , . . . ,t k ]. (1) 

It then follows from the definition of rigidity that RIG(n, r, tt) is the projection from A™ 2 x A k 
to A n of the algebraic set V(I(n, r, n))(F). Thus, if we define the elimination ideal 

EI(n, r, 7r) := I(n, r, tt) fl F[xx, x.„ 2 ] C F[xi, x n2 ], 

then by the Closure Theorem (Theorem 3), we obtain 

W(n,r,ir)=V(EI(n,r,ir)). (2) 

Note that 

W(n,r,0)= [J W( n, r, 7Tj. 
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2.2 Valiant's Theorem 



The following theorem due to Valiant [Val77, Theorem 6.4, page 172] says that a generic 
matrix has rigidity (n — r) 2 . That is, for k < (n — r) 2 , the dimension of W(n, r, ^ k) is 
strictly less than n 2 . 

A reader familiar with Valiant's proof will realize that our proof is basically a rephrasing 
of Valiant's proof in the language of algebraic geometry. The point of this proof is to set up 
the formalism and use it later; in particular, when we compute the exact dimension of the 
rigidity variety W(n, r, ^ k). 

Theorem 4. (Valiant) Let n ^ 1,0 < r < n and ^ k < (n — r) 2 . Let W := W(ri, r, ^ k) 
be as above. Then, 

dim(W) < n 2 . 

Proof. Let it C {(i,j)|l ^ i,j ^ n} be a pattern of size k. Let r be the index set of a 
fixed r x r minor. For a matrix £>, let B T denote the minor of B indexed by r. Define 
RIG(n, r, 7r, r) to be the set of all n x n matrices A that satisfy the following properties: there 
exists some n x n matrix T w such that 

1. Supp(T n ) C 7T, 

2. rank(A + T n ) = r, and 

3. det((A + T n ) T ) ^ where r denotes the fixed r x r minor as above. 

Recall that S^vr) is the set of matrices whose support is contained in w. Let us also define 

RANK(n, r,r) := {C G M n | rank(C) = r anddet(CV) ^ 0}. 

By definition, every element A £ RIG(n, r, 7r, r) can be written as C — T n , with C £ 
RANK(n, r,r) and T w £ 5(vr). 

The following lemma is proved in Appendix B. 

Lemma 5. dim(RANK(n, r, r)) = n 2 — (n — r) 2 . 

Consider the following natural map $: 

A nM«-0 2 x A k D RANK(n, r, r) x 5(tt) M„ = A n ', (3) 

taking (X, T n ) to X + T n . The image of $ is exactly RIG(n, r, 7r, r). 

Also, note that dim(5'(7r)) = \ir\. We note that if there is a surjective morphism from an 
affine variety X to another affine variety Y, then dim Y ^ dim X (a more formal statement 
appears as Lemma 22 in Appendix A). Thus for k ^ (n — r) 2 — 1, we get 

dim(Jm($)) = dim(RIG(ra, r, 7T, r)) ^ n 2 — (n — r) 2 + k < n 2 . 

Note that 

W = |jRIG(r2,r,7r,r) 

T.7T 

and that completes the proof of the theorem, h 
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Thus we have proved that the set of matrices of rigidity strictly smaller than (n — r) 2 is 
contained in a proper closed affine variety of A n , and thus is of dimension strictly less than 
n 2 . In other words, a generic matrix, i.e. a matrix that lies outside a certain proper closed 
affine subvariety of A n , is maximally rigid. Therefore, over an infinite field F (for instance, 
an algebraically closed field), there always exist maximally rigid matrices. 

We now refine Valiant's argument and prove the following exact bound on the dimension 
of W. The main point of the proof is a lower bound on dim(W). 

Theorem 6. Let ^ r ^ n and ^ k ^ [n — r) 2 . Then 

dim(W) =n 2 - {n- r) 2 + k. 

Proof. With the notation of the previous proof, we have the map 

$ : RANK(n, r, r) x S(tt) -> M n . 

defined above. Let RANK(?i, «C r), RANK(n, r) be the set of n x n matrices of rank at most 
r and exactly r respectively. Let S(k) be the set of matrices of support at most k. 

Now note that GL(n) x GL(n) acts on RANK(n, ^ r) by multiplication on the left and 
the right, and that the action is transitive on the set of matrices with rank exactly r, which 
forms a Zariski open subset of RANK(n, $C r). Therefore RANK(n, ^ r) is an irreducible 
algebraic variety. It is not difficult to see (for instance, from the computation below of the 
tangent space) that its singular locus is exactly RANK(n, ^ r — 1), the set of matrices with 
rank less than r. 

On the other hand, S(k) splits into components S(tt) depending on the pattern ir and 
is thus a union of various affine subspaces (each associated to a ir of size at most k). The 
nonsingular elements of S(k) are those which have support of size exactly k. 

We can put together the maps $ arising from various choices of r and 7r to write the map 

$ : RANK(n, ^ r) x S(k) -> RIG(ra,r, ^ k). 

We can easily see that $ is a surjective morphism of affine varieties. If we can find a nonsin- 
gular point of RANK(ri, «C r) x S(k) for which the map on tangent spaces is injective, then 
the dimension of the target space RIG(n, r, ^ k) will equal dimRANK(n, ^ r) + dim5'(A;) = 
n 2 — {n — r) 2 + k, proving the theorem. Since the map on tangent spaces is simply addition of 
matrices, we need to show that the subspaces do not intersect non-trivially and that would 
complete the proof of the theorem. For any smooth point x G RANK(ra, r), the smooth locus 
of RANK(n, ^ r), we will find a pattern 7r of size k and y G S(ir) for which the tangent spaces 
at x and y intersect transversely. 

Assume first that the point x is ( ^ r jjj . We choose the pattern n to lie completely in 

the bottom right hand block of size (n — r) x (n — r), and choose any smooth point y of S(ir) 
(i.e. having all k entries nonzero). 

The tangent space of x is 
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That is, it consists of the subspace of M n consisting of matrices with arbitrary entries 
except in the lower (n — r) x (n — r) block, which is constrained to be the zero submatrix. 
The dimension of the tangent space is r 2 + 2r(n — r) = n 2 — (n — r) 2 , as expected. The 

tangent space of y is ( _ j where *„. means that the entries in positions of ir are arbitrary, 



and the other entries are zero. 

It's clear that these two tangent spaces intersect transversely. 

Now, we need to show this for a more general x G RANK(n, r). Assume that the top left 
r x r minor of x is nonsingular (else we can multiply by permutation matrices on left and 
right, noting that permutations just shuffle the various S(ir) for \tt\ = k). 

The first r columns of x are independent and span the column space of x, so there exists a 

matrix q — \ ^ * | such that xq has the form ( ^ } . Then using that the first r rows of 

V I n -r / V * 



xg are independent and span its row space, we can find an invertible matrix h 



* 

* I 



n—r 



such that hxg = jjj . The tangent space of x is h 1 ^* *J g 1 . We need to show this 

does not intersect S(ir) for some ir. That is, I ^ ^ J does not intersect ^ ( g ^ J fi 1 except 

in zero. But this follows from the fact that the latter is a matrix of the same form (in fact, 
multiplication by h and g leave any element of S(ir) unchanged). ■ 

Remark 7. A similar argument or line of study - though in the projective setting - is also 
found in [LTV03]. Our formalism and proofs seem clearer and simpler. Our theorem is also 
very explicit. 



2.3 Rigid Matrices over the field of Complex Numbers 

Recall that to say that the rigidity of a matrix A for target rank r is at least k, it suffices 
to prove that the matrix A is not in W(n, r, ^ (k — 1)). We use this idea to achieve the 
maximum possible lower bound for the rigidity of a family of matrices over the field of 
complex numbers C. As a matter of fact, we obtain matrices with real algebraic entries with 
rigidity (n — r) 2 . 

Theorem 8. Let 5(n) = n 4 " 4 . Let pij for 1 ^ i, j ^ n be distinct primes such that 
PiJ > 5(n). Let K = Q(G,i, . . . , Cn,n) where Q,j = e 2 ™'** . Let A(n) := (&,,) G M(n,K). 
Then, for any field L containing K , 

Rig(A(n), r, L) = {n — r) 2 . 

Proof. For simplicity, we will index the by ( a for a = 1 ton 2 , and similarly p a . We prove 
the theorem by showing that 

A(n) W(n, r,^(n- r) 2 - 1)(L). 



S 



Thus it is sufficient to prove that 

A(n) i W(n,r,ir)(L) 

for any pattern tt with | vr ] = {n — r) 2 — 1. Let tt be any such pattern. To simplify notation, 
let us define, W := W(n, r, tt)(L). By Theorem 4 we have: 

dim(>V) ^ dim(W(n, r, < (n - rf - 1)) ^ (n 2 - 1) < n 2 . 

Equivalently (by Hilbert's Nullstellensatz) , 

EI(n,r t n)?(0). 

Proving that A(n) ^ W is equivalent to showing the existence of a g G EI(n, r, tt) such that 
g(A{n)) ^ 0. We produce such a g using the following theorem: 

Theorem 9. ( [BMMR02] , page 6, Theorem 4) Let I = 6e an ideal in 

the polynomial ring F[Y] over an infinite field F, where Y = {yi, . . . ,y m }. Let d be the 
maximum total degree of the generators /j. Let Z = {y iiy . . . , y i( } C Y be a subset of 
indeterminates ofY. If I PI F[Z] ^ (0) then there exists a non-zero polynomial g G In -FfZ] 
swc/i t/iat ; g = ~Y^i=i9ifii w tth 9i e -^IX] an d deg(gifi) ^ (fi + l)(m + 2)(d /i + l)^" 1-2 , where 
fi = min{s, m}. 

Let us apply Theorem 9 to our case - in the notation of this theorem our data is as follows: 
F := Q, Y := {x±, . . . , x n 2, t\, . . . , Z := {x±, . . . , x n 2}, E r+ i := set of all minors of size (r+ 
1), f T : = det((X + T W ) T ) for r G S r+ i, here by Y T we denote the r-th minor of Y, and 
/ := I{n, r, tt) = (f T : r G S r+ i) as defined in (1). 

Furthermore, we have: 

m = n 2 + (n - r) 2 - 1 ^ 2n 2 - 2 

/i = min i^n 2 + {n — r) 2 — 1, 

^ n 2 + (n - r) 2 - 1 ^ 2n 2 - 2, 
d = r + 1 ^ n, 
/nF[Z] = EI(n t r,ir) ^ (0). 

By Theorem 9 there exists a 

c/ 7^ G £7(n, r, tt) C Q[xi, . . . , x n i\ 

such that 

deg(o) ^ (2n 2 - l)(2n 2 )(n 2n2 - 2 + l) 2 ™ 2 < n 4n * = <S(n). 
We will now apply the following Lemma 10, which we prove later, to this situation. 




9 



Lemma 10. Let N be a positive integer. Let 9i, ■ ■ ■ ,9 m be m algebraic numbers such that 
for any 1 ^ i ^ m, the field Q(#i) is Galois over Q and such that 

[Q(6i) :Q]^N and 

Q(9i) n Q(0i, . . . , 9i- u 9 i+1 , 6 m ) = Q. 
Let g(x) 7^ G Q[x\, . . . , x m ] such that deg(g) < N. Then, 

g(e 1 ,...,e m )^o. 

Let us set m = n 2 , N = 5(n), I := deg(g) ^ N in Lemma 10. It is now easy to check that 

[®(Ca):Q]=Pa-l>S(n) = N 

and 

Q(Ca) n Q(Cl, • • • , Ca-l, Ca+1, ■ ■ ■ , CnO = Q- 

The latter follows from the fact that the prime p a is totally ramified in Q(C«) and is un- 
ramified in Q(Ci, • • • , ( a -i, (a+i, ■ ■ ■ ,(n 2 )', see Theorem 4.10 in [Nar04]. Thus Lemma 10 is 
applicable and we get: 

<7(Cl,...,C»»)^0. 

To complete the argument (for Theorem 8), now we prove Lemma 10. 

Proof of Lemma 10 : By induction on m. For m = 1 this is trivial. Now suppose that 
the statement is true when the number of variables is strictly less than m. Assuming that 
the statement is not true for m, we will arrive at a contradiction. This will prove the Lemma. 
Let g G Q[x] with I := deg(g) < N be such that 

g(9 1 ,...,9 m ) = 0, 

with 9i, 1 ^ % ^ m, satisfying the conditions as in the theorem. Since the statement is true 
for any (m — 1) number of variables, without loss of generality, we can assume that all the 
variables and hence x m appears in g. Let us denote x m by x. Let us write 

i 

g(x\j . . . , x m ) y fi^Xi, • • • , x m —\)x 

i=0 

Note that I < N and deg(/j) < A" for ^ % ^ I. Since g ^ 0, for some i, ^ % ^ I the 
polynomial /; ^ 0. Thus, by the inductive hypothesis, 

fi{9i, • • • , 9 m -i) ^ 0. 

Thus g(9±, . . . , 9 m _i)(x) ^ G Q(#i, • • • , 9 m _i)[x]. This implies that 9 m satisfies a non-zero 
polynomial over Q(9±, . . . , of degree ^ / < N. Thus: 

[®(9 1 ,...,9 m ):Q(9 1 ,...,9 m _ 1 )}^l<N. (4) 
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On the other hand, since Q(6 m ) n Q(#i, . . . , d m -i) = Q an d the fields Q(#j) are Galois over 
Q, by Theorem 11 (stated below), we conclude that 

[Q(9 u ... t e rnr . 1 )(e m ):Q(e 1 ,... t e m - 1 )] = [Q(9 m ) -Q]> n. 

This contradicts (4) above and that proves the lemma. 

Theorem 11. ([Lan04], Theorem 1.12, page 266) Let K be a Galois extension of k, let 
F be an arbitrary extension and assume that K, F are subfields of some other field. Then 
KF (the compositum of K and F) is Galois over F, and K is Galois over Kf]F. Let H 
be the Galois group of KF over F, and G the Galois group of K over k. If a G H then 
the restriction of a to K is in G, and the map o i— > o~\k gives an isomorphism of H on the 
Galois group of K over K R F . In particular, [KF : F] = [K : K fl F\. 

This concludes the proof of Theorem 8.m 

Note that Theorem 8 is true for any family of matrices A(n) = [Oij] provided the 9ij 
satisfy Lemma 10. Hence, we have: 

Corollary 12. Let A(n) := {(i,j+d,j), where are primitive roots of unity of order pij such 
that pi j — 1 ^ 25(n) (here Qj denotes the complex conjugate ofQj). Then, A(n) G M(n, R) 
has Kig(A(n), r) = (n — r) 2 . 

3 Reduction to Determinantal Ideals 

In this section, we show that the natural decomposition of the rigidity varieties W(n, r, ^ 
k) = U| 7r | = / c W(n, r, 7r) is indeed a decomposition into irreducible affine algebraic varieties. In 
fact, these components turn out to be varieties defined by elimination ideals of determinantal 
ideals generated by all the (r + 1) x (r + 1) minors. As an application of this, we remark 
that as noted in the introduction, in order to improve the bounds on order of the primitive 
roots in our rigid matrix in Theorem 8, it suffices to improve the degree bounds given by 
Theorem 9 for the special case when / is a determinantal ideal. However, we do not know of 
such an improvement even for the special case when I is the determinantal ideal of a generic 
Vandermonde matrix. 

To show the decomposition, we will continue to use the notation from Section 2. Consider 
the matrix X + T v . Let x = {x±, . . . , x n i\ = U x n , where x n is the set of variables that 
are indexed by 7r and x^ is the set of remaining variables. 

Let 

J := J(n,r,7r) = (Minors( r+1)x ( r+1 )(X + T v )) 

be the ideal of Q[x, t] = Q[x n , x^, t n ] generated by the (r + 1) x (r + 1) minors of X + T n . 
Let 

Ji := JnQ[z ff ,Zjf] C Q[xi, . . . ,x n2 ], 

■h ■■= JinQbif], 

I r+1 := (Minors {r+1)x{r+1) (X)) CQ[x], and 
EI r+1 := / r+ inQ[%] C Q[x s ]. ' 
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Notice that since J\ is the elimination ideal of J w.r.t. eliminating variables t n , a matrix A 
lies in W(n, r,^k) = RIG(n, r, ^ k) if and only if its entries lie in the variety defined by the 
ideal J\. Also, I r+ i is the ideal generated by the (r + 1) x (r + 1) minors of X and EI r+ i its 
elimination ideal for the rational ring generated by the variables x^. 

Proposition 13. J\ = JzOfa] (the ideal generated by J2 in Q[x}) and J2 = EI r+ \. In 
particular, EI(n,r,7r) = EI r+ iQ[x] considered as ideals in Q[x], 

Proof. First, notice that in the (r + 1) x (r + 1) minors of X + T n , the variable tij, for 
G 7r, always occurs in combination with Xij as ijj + Xij. Therefore, eliminating the 
variables t n will also automatically eliminate the variables x w , giving the equality of the 
generators of the ideals J\ and J2. Therefore J\ = fyQlx]. More formally, consider the 
isomorphism between the two coordinate rings <fi : Q[x n ,x^,t n ] and Q[x n ,x^,t n ] defined by 
letting 4>(tij) = Xij + for each G n and <j>(xij) = Xij for all 7r. The ideal 
J\ = JnQfxTr,^^] C Q[x±, . . . ,x n 2] must equal the ideal 0(0 _1 (J) n0 -1 Q[xi, . . . ,2^2]), since 
<p is an isomorphism. But </> _1 (J) is generated by matrices only involving the variables of t„ 
and Xn, whereas _1 Q[xi, . . . , x n a]) = Q[x±, . . . ,x n z], so that _1 (J) fl _1 Q[a;i, . . . ,x n 2] is 
generated by polynomials only involving the variables of 2%. Therefore <fi~ l (Ji) = <fi~ l (J) fl 
_1 Q[a;i, . . . ,x n 2] = J2QH and taking the image under 0, we get Ji = J 2 Q[x]. 

The equation J2 = EI r+ \ follows from similar considerations, noting that the variables Xij 
for G vr always occur in the combination Xij+tij. Therefore eliminating them eliminates 
t^j as well. More formally, consider the isomorphism ip : Q[x n ,x^,t n ] — > Q[x n , x^, t n ] defined 
by letting ij){xij) = x^j + t it j for each G ir, while i/)(U t j) = t it j for G ix and 

4>{xij) = Xij. Then again we have J 2 = J\ flQ^] = JflQ[x # ] = if) (if) -1 (J) n^~ 1 (Q[x s -])) = 
(j>(I r ' +1 Q[x,L) n Q[x*]) = 0(^+1) = £I r+ i C Q[^]. . 

The following is a well-known theorem; see [HE71, Theorem 1] and [BV80, Chapter 2]. 

Theorem 14. Let RANK(n, ^ r) be the set of all rank ^ r matrices of M n = A" 2 . Then 

• J(RANK(n, ^ r)) = I r+1 and RANK(n, ^ r) = 7(J r+ i). 

• 7 r+ i is a prime ideal ofQ[X]. In particular, RANK(n, ^ r) is an irreducible variety. 

Corollary 15. In the natural decomposition W(n,r, ^ k) = U\ n \ = kW(n, r, it), the W(n, r, n) 
are irreducible varieties. 

Proof. The elimination ideal EI r+ i C Q[x^] is a prime ideal since I r+ \ C Q[x] is prime by 
Theorem 14. By Proposition 13, V(EI r+ i) = V(EI(n,r,ir)) is irreducible in A n . Now, by 
(2), we conclude that W(n, r, tt) is an irreducible affine variety. ■ 

4 Semicontinuity of Rigidity 

Intuitively, if a function is (lower) semicontinuous at a given point, then within a small neigh- 
borhood of that point the function is nondecreasing. A formal definition of semicontinuity 
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appears in Appendix C. The rank function of a matrix, for example, is a lower semicontinu- 
ous function on the space of all n x n complex matrices. In Appendix C, we give examples to 
show that the rigidity function is not semicontinuous in general. However, it seems to have 
semi continuity property at some interesting matrices. In particular, the matrices A(n) from 
Theorem 8 have an open neighborhood around them within which the rigidity function is 
constant. This is a direct consequence of their very construction since they are outside the 
closed sets W(n, r, ^ (n — r) 2 — 1). Another finite example with square roots of primes as 
its entries appears in Appendix C. 

The above examples motivate us to study the properties of the Euclidean closure and 
Zariski closure of the set RIG(n, r, ^ k)(C). In fact, we are able to argue that these two 
coincide. 

Proposition 16. The Euclidean Closure o/RIG(n, r, ^ k)(C) equals its Zariski Closure. 

Proof. Recall that we can write RIG(n,r, ^ k) = {J n , RIG(n, r, it). Thus, to prove 
the proposition, it is sufficient to prove that for any pattern it, the Euclidean closure of 
RIG(n, r, 7t) equals its Zariski Closure. By Closure Theorem, there exists a subvariety V 
strictly contained in W := RIG(n, r, vr) such that W(C) - V(C) C RIG(n, r, tt)(C) C W(C). 
Since W(C) is closed in the Euclidean topology, we will done if we prove that the Euclidean 
closure of W(C) — V(C) is W(C). This is precisely the statement of the following lemma 
from [Sha94b], which we state below for easy reference. Also note that, by Corollary 15, W 
is an irreducible variety for every pattern it and hence the lemma is applicable. ■ 

Lemma 17. ([Sha94b, Lemma 1, page 124]) If X is an irreducible algebraic variety 
and Y a proper subvariety of X then the set X(C) — Y(C) is dense in X(C). 
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A Background on Algebraic Geometry 

In this section, we recall some basic notions from algebraic geometry. 

Let F be a field. Let F denote a fixed algebraic closure of F. Let X\, ■ ■ ■ , x n be n 
algebraically independent variables over F. Let F[x\, - ■ ■ ,x n ] be the polynomial ring in n 
variables over F. An ideal / is by definition a sub-module of the ring F[x\, ■ ■ ■ , x n ]. More 
explicitly, J is a subset of F[x±, ■ ■ ■ , x n ] which is a subgroup of F[x±, ■ ■ ■ , x n ] under addition, 
and which is also closed under multiplication by elements of F[x±, ■ ■ ■ , x n }. 

By an algebraic set S C F n we mean a subset V(E) of zeros of some subset £ of 
F[xi,...x n ]. Given a subset £ of F[xx,...x n ] we may consider the ideal Is = (E) gen- 
erated by E in F[xi, . . . x n ]. Given an ideal I of F[x±, ■ ■ ■ , x n ] and a field L containing F, by 
V(I)(L) we mean the set of points a := (ai, • • • , a n ) such that a is a zero of all polynomials 
belonging to / and all the a,; G L. We let V(I) denote the affine variety defined by / over 
F. This is a geometric object with a natural structure of a topological space, where the 
closed subsets are V(J) for ideals J C F[x\, . . . ,x n ] containing I. This is called the Zariski 
topology. The algebraic set V(I)(L) consists of the L-points of the affine variety V(I). 

V(I)(L) := {a = (ax, • • • , a n ) eL n \\/feI, /(a) = }. 
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On the other hand, given a subset S of F n , let us define I(S) to be the set of polynomials 
/ G F[xi, ■ ■ ■ ,x n ] such that f(s) = Ws G S. It is easy to see that I(S) is an ideal of 
F[x\, ■ • ■ , x n }. Let us define: 

VT := {/ G • • • , x n ] | 3m G N such that / m G /}. 

\/7 is called the radical of the ideal I. We then have the following basic theorems. 
Theorem 18. (Hubert's Nullstellensatz) Let I be an ideal of F[x\, ■ ■ ■ ,x n ]. 

Vi = i(v(i)). 

We will always deal with radical ideals, namely those I which are equal to y/1. The affine 
variety V(I) is often interchangeably used with its F-valued points V(I)(F), which is the 
algebraic set it defines. 

Given a subset S of F n , the Zariski-closure of S to be denoted by Z(S) or S is by definition 
the smallest algebraic subset of F n containing S that is defined by a set of polynomials with 
coefficients in F. 

We call an algebraic subset S irreducible if it can not be written as a union of two algebraic 
sets Si and £2 properly contained in S. Note that X is irreducible if and only if I(X) is a 
prime ideal. 

A morphism <p : X C A n — > A 1 from an affine closed subvariety of affine n-space to 
the affine line is a polynomial map (xi, . . . x n ) 1— > p(xi, . . . , x n ) where p is a polynomial. We 
naturally extend this to a morphism between affine varieties. 

Definition 19. Let X C A™ and Y C A m be two closed affine varieties. A morphism 
<f> : X — > Y is defined to be a map (ft whose components are polynomials. In other words, (ft 
has the form: 

(f)(Xi, . . . x n ) = (fi(xi, . . . , x n ), . . . , f m (xi, . . . , x m )) 

where fi, ■ ■ ■ f m are polynomials, and with the property that it maps the subset X to Y . 
The morphism <f> is called dominant if <fi(X) is dense in Y . 

Let X be a closed affine variety of A n over the field F associated with the ideal I(X). 
Let F(X) denote the ring of fractions of the quotient ring R = F[xi, . . . , x n ]/I. If I(X) is a 
prime ideal, F(X) is a field and is called the function field of X. Elements of the function 
field F(X) are called the set of rational functions on the variety X. 

Definition 20. Let K be a finitely generated extension field over a base field F. Let S be 
a maximal set of algebraically independent elements of K over F . Such an S is called a 
transcendence basis of K over F . It can be proved that \S\ is independent of S, and is called 
the transcendence degree of K over F and will be denoted by tr.deg(K/F). 

Definition 21. The dimension of an affine variety X C F n denoted by dim(X) is the 
transcendence degree of the function field F(X) of the variety X over the base field F. Thus, 
dim(X) := tr.deg(F(X)/F). 

For easy reference we state a lemma below that we need. 
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Lemma 22. ([Sha94a]) Let <fi : X — > Y be a dominant morphism. Then <p* induces a 
natural isomorphic inclusion of k(Y) > k(X). In particular, dim(y) = tr.deg(k(Y)) $C 
tr.deg(k(X) = dim(X). 

We have described closed affine subvarieties of affine n-space. In particular, a closed 
subset of A n that is cut out by a single polynomial / in n variables is called a hypersurface 
V(f). Now, it can be shown that the Zariski topology of A™ has a basis of open sets given 
by the complements of these hypersurfaces, D(f) = A n \V(f). Now D(f) is itself isomorphic 
to an affine variety, namely the hypersurface fy = 1 in A n x A* In general, a space which 
we can thus identify naturally with a closed affine subvariety in some affine space (in a sense 
that we will not make precise here) is called an affine variety. An important example of this 
is the open affine GL n C M n of invertible matrices, which is defined by the nonvanishing of 
the determinant. 

A general algebraic variety X is obtained by glueing together various pieces X, such that 
Xi is an affine variety. The notion of glueing means that there are open varieties Uy C Xi 
and compatible isomorphisms — > Uji between them (so that we can think of Uij as the 
intersection of Xi and Xj). 

Definition 23 (Tangent Spaces and Transversal Intersection). Let p G V C A n be a point 
on an affine variety defined by f\ = f'2 = ■ ■ ■ fi = 0. Then we define the tangent space at 
p = (pi, . . -Pn), denoted by T p V , to be the common zeroes of the £ polynomials : 



Thus, dimTpV = n — rank(J) , where J is the Jacobian matrix. Points on the variety where 
dimTp\^ = dim^ are called non-singular or smooth points. Points where dim TpV" 7^ 
dimV are called singular points. Two subvarieties of a given variety are said to intersect 
transversally if at every point of intersection, their separate tangent spaces at that point 
together generate the tangent space of the variety at that point. 

B Proof of Lemma 5 

We first recall the statement and then give the proof. 
Lemma: dim(RANK(n, r, r)) = n 2 — (n — r) 2 .. 

Proof. Without loss of generality we can assume that the r is the upper left r x r-minor. 
Thus we can write a C G RANK(n, r, r) as 



where rank(C) = r and C\\ is an r x r matrix whose determinant is non-zero. 

Since the matrix C\\ is nonsingular of dimension equal to r = rank(C), it follows that 
the first r columns are linearly independent and span the column space of C. Therefore 
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each of the last (n — r) columns is a linear combination of the first r columns in exactly one 
way, and the linear combination is determined by the entries of C\2- Formally, we have the 
equation 



<^22 — <^2lWl ^ 



The set of all C\\ is an affine open set of dimension r and C12 and C21 can each range over 
^r(n-r)_ H ence; algebraic set RANK(n, r, r) has dimension exactly r 2 + 2r{n — r). ■ 



C Examples and Counterexamples for Semicontinuity 
of Rigidity 

Definition 24. Semicontinuity: 

Let Y be a topological space. A function <ft : Y ^> Z is (lower) semicontinuous if for 
each n, the set {y £ Y\<p(y) ^ n} is a closed subset of Y . That is, for each y there is a 
neighbourhood U of y such that for y' £ U, <p(y') ^ <P{y)- Intuitively, <fi can jump up only at 
special points, and it can't jump down. 

We illustrate that rigidity function is not lower semi-continuous. That is, we show that 
there is an infinite family of matrices {M n } n ^i, for which for any n, for any e n , there is a 
matrix N n which is e n -close to M n such that rigidity of N n is strictly smaller than that of 



The following is an example for 3x3 matrices 
numbers. Consider 

a b c 

A 



Let a, b, c, d, e be non-zero rational 



£ M(3,C) 



Observe that rank(A) = 2 and by changing two entries its rank can be brought down to 1. 
Hence, Rig(A, 1) = 2. Now for any e > let 



B 



b 

bd8 
beS 



c 
cd5 
ce5 



£ M(3,C), 



where 5^0 and 5 7^ 1/a is such that e ^ m&x{bd5, cd5, beS, ceS}. Thus B is in the open ball 
of radius e around A. Note that rank(B) = 2. Also Rig(-B, 1) = 1 because changing a to | 
will make all the 2x2 sub-determinants of B zero. Thus, we have a matrix B which is in 



the e open ball around A such that Rig(v4, 1) > Rig(£>, 1} 
any given n, let 



To produce an infinite family, for 



.4, 



a 



>n-\ 



«1 






a 2 














£ M(n, C). 
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Then, we have: 

Lemma 25. For n ^ 3, rank(A r 



2, Ri g (A„,i; 



n 



Proof. By Induction: We already argued for the base case when n = 3. It is easy to see that 
rank(v4 n .) = 2. In fact, all the 2x2 subdeterminants involving at, bi and a are non-zero. So 
we have to change at least (n — 1) entries so that all the 2x2 subdeterminants vanish. On 
the other hand, it suffices to change all the a« from i = 2 to n to reduce the rank to 1. ■ 

Similarly for any e, choose an 5 such that e ^ maxi^-ja^f?)}. 



B, 



a a\ a 2 
bi a±biS a 2 bi5 
b 2 aib 2 5 a 2 b 2 5 



b n aib n 5 a 2 b n 5 



a n 
a n b\5 
a n b 2 5 



a n b n S 



G M(n, 



Observe that for every sub-determinant of A n that is non-zero, the corresponding sub- 
determinant of B n will also remain non-zero. Thus rank(B n ) = 2. Also Rig(I? n , 1) = 1 
because if one changes a to I then every 2x2 sub-determinant becomes zero. Now we 
concentrate more on the 3x3 example A3 



A 



a b c 
d 
e 



As seen earlier, A £ RIG(3, 1, 2) and yet there are matrices arbitrarily close to it that belong 
to RIG(3, 1,1). Thus A is in the Euclidean closure of RIG(3, 1,1), hence it is also in the 
Zariski closure of RIG(3, 1,1), since the Euclidean or complex topology is finer than the 
Zariski topology. 

Let us verify this directly. We want to verify that A £ (J W(3,l,7r,^ 1). We do this by 
demonstrating a pattern n such that A £ W(3, 1, n, ^ 1). Let tt := {(1, 1)}. Let us write: 



X + h := 

where ti is the variable associate to n. Here we get: 



xi + ti x 2 x 3 

X 7 X 8 Xg 



1(3, 1,1, IT) = (tiX 5 + XiX 5 - X 2 X 4 ,tiX 6 + XiXq - X3X4, 
tiX 8 + XiXs - X 2 X 7 , tiX Q + XiXg - X3X7, 

X 2 Xq - x 3 x 5 , x 2 x 9 - x 3 x 8 , x A x% - X 5 X 7 , 

X4X9 - X 6 X 7 , £5X9 - X 6 X$) 
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Eliminating t\ from J(3, 1, 1, tt) using the Groebner Basis algorithm we get: 



£7(3,1,1,71-) = (x 2 Xq - X 3 X 5 ,X 2 Xg - X 3 X 8 ,X A X 8 - X 5 X 7 , 

x A x 9 - x 6 x 7 , x 5 x 9 - x 6 x 8 ) 

Note that A does satisfy these generating polynomials. However, this does not mean that 
A is in the Euclidean closure, as in general, it could be that Euclidean closure is strictly 
smaller than the Zariski closure. 

Examples which are maximally rigid: Now we produce examples of matrices with 
maximum rigidity where the semi-continuity property of rigidity fails. Take a matrix 



A 



a b c 
d e 
9 i 



where a,b, . . . ,g are non-zero rational numbers. n = 3,r = l,A; = 3. Notice that changing 
4 entries (namely a, b, d, e) will be enough to bring the rank down to 1. It is easy to verify 
that changing 3 entries will not suffice for a general choice of a, . . . , i. Thus, Rig(A, 1) = 4 = 
(3- l) 2 = (n-r) 2 . 

Let M be a generic matrix and let 7r be the diagonal pattern of size 3 (represented by 
variables t±, t 2 , t 3 . Consider: 



M + T n 



a + ti 
d 

9 



b 

e + t 2 
h 



c 
f 

i + h 



It can be checked that the elimination ideal is generated by bfg — cdh. Note that A satisfies 
this equation and thus it follows that A G RIG(3, 1, 3, tt). This implies that any Zariski 
open neighbourhood of A intersects RIG(3, 1, 3, it)). This is straightforward consequence of 
the definitions. What is unclear is whether every euclidean neighbourhood of such an A 
intersects RIG(3, 1, 3, tt). However, this suggests a technique for proving that there is an e 
such that e-neighbourhood of a matrix does not contain matrices of strictly smaller rigidity. 
For this we closely studied the Zariski closure of matrices of rigidity atmost k — 1 (for some 
k). For a matrix M of rigidity at least k, if we prove that it does not lie in the above closure, 
it means that it is in the complement of a Zariski closed set, and hence in a Euclidean open 
set. Thus there is an e such that e-neighbourhood of M matrix does not contain matrices of 
rigidity smaller than k. 

We illustrate the above technique by an example: Consider the matrix 



M :-- 



2 3 5 
7 11 13 
17 19 23 



G M(3,C). 



It is easy to check that Rig(M, 1) = 4. That is M £ RIG(3, 1,4), and we want to prove 
that M £ W(3,l,3)). 
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We want to check this for all patterns n. But we can quickly rule out some of them 
quickly as follows. Consider the pattern matrix T n such that 



M + T n 



In the elimination ideal, the equation: 



a + ti 
d 
9 



b + t 2 c + t 3 

e f 
h i 



f 



which will not be satisfied by M. It is 



easy to check that the matrix M, due to its choice of entries, has the property that all the 
submatrices have full rank. Thus, the pattern T n should touch all 2 x 2 minors. Thus, up to 
permutations (since choice of primes in M could be arbitrary but distinct) we need to check 
the case when T n has the variables on the diagonal 
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In this case, the elimination ideal is generated by a single polynomial, namely bfg — cdh, 
which M does not satisfy. Since upto permutations, all patterns of size 3 can be written 
as above, we conclude that M £ W(3, 1,3). But in addition, by the above argument about 
semi-continuity, it will also imply that for the matrix M p , there is an e such that all the 
matrices in the e-neighborhood are outside W(3, 1,3). 
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